An Improved Learning Algorithm for Augmented Naive Bayes

Data mining applications require learning algorithms to have high predictive accuracy, scale up to large datasets, and produce compre-hensible outcomes. Naive Bayes classiier has received extensive attention due to its eeciency, reasonable predictive accuracy, and simplicity. However , the assumption of attribute dependency given class of Naive Bayes is often violated, producing incorrect probability that can aaect the success of data mining applications. We extend Naive Bayes classiier to allow certain dependency relations among attributes. Comparing to previous extensions of Naive Bayes, our algorithm is more eecient (more so in problems with a large number of attributes), and produces simpler dependency relation for better comprehensibility, while maintaining very similar predictive accuracy.